Subword-based approaches for spoken document retrieval

Thesis (Ph.D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2000.Includes bibliographical references (p. 181-187).This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.This thesis explores approaches to the problem of spoken document retrieval (SDR), which is the task of automatically indexing and then retrieving relevant items from a large collection of recorded speech messages in response to a user specified natural language text query. We investigate the use of subword unit representations for SDR as an alternative to words generated by either keyword spotting or continuous speech recognition. Our investigation is motivated by the observation that word-based retrieval approaches face the problem of either having to know the keywords to search for [\em a priori], or requiring a very large recognition vocabulary in order to cover the contents of growing and diverse message collections. The use of subword units in the recognizer constrains the size of the vocabulary needed to cover the language; and the use of subword units as indexing terms allows for the detection of new user-specified query terms during retrieval. Four research issues are addressed. First, what are suitable subword units and how well can they perform? Second, how can these units be reliably extracted from the speech signal? Third, what is the behavior of the subword units when there are speech recognition errors and how well do they perform? And fourth, how can the indexing and retrieval methods be modified to take into account the fact that the speech recognition output will be errorful?(cont.) We first explore a range of subword units ofvarying complexity derived from error-free phonetic transcriptions and measure their ability to effectively index and retrieve speech messages. We find that many subword units capture enough information to perform effective retrieval and that it is possible to achieve performance comparable to that of text-based word units. Next, we develop a phonetic speech recognizer and process the spoken document collection to generate phonetic transcriptions. We then measure the ability of subword units derived from these transcriptions to perform spoken document retrieval and examine the effects of recognition errors on retrieval performance. Retrieval performance degrades for all subword units (to 60% of the clean reference), but remains reasonable for some subword units even without the use of any error compensation techniques. We then investigate a number of robust methods that take into account the characteristics of the recognition errors and try to compensate for them in an effort to improve spoken document retrieval performance when there are speech recognition errors. We study the methods individually and explore the effects of combining them. Using these robust methods improves retrieval performance by 23%. We also propose a novel approach to SDR where the speech recognition and information retrieval components are more tightly integrated.(cont.) This is accomplished by developing new recognizer and retrieval models where the interface between the two components is better matched and the goals of the two components are consistent with each other and with the overall goal of the combined system. Using this new integrated approach improves retrieval performance by 28%. ...by Kenney Ng.Ph.D

DPVis: Visual Analytics with Hidden Markov Models for Disease Progression Pathways

Clinical researchers use disease progression models to understand patient status and characterize progression patterns from longitudinal health records. One approach for disease progression modeling is to describe patient status using a small number of states that represent distinctive distributions over a set of observed measures. Hidden Markov models (HMMs) and its variants are a class of models that both discover these states and make inferences of health states for patients. Despite the advantages of using the algorithms for discovering interesting patterns, it still remains challenging for medical experts to interpret model outputs, understand complex modeling parameters, and clinically make sense of the patterns. To tackle these problems, we conducted a design study with clinical scientists, statisticians, and visualization experts, with the goal to investigate disease progression pathways of chronic diseases, namely type 1 diabetes (T1D), Huntington's disease, Parkinson's disease, and chronic obstructive pulmonary disease (COPD). As a result, we introduce DPVis which seamlessly integrates model parameters and outcomes of HMMs into interpretable and interactive visualizations. In this study, we demonstrate that DPVis is successful in evaluating disease progression models, visually summarizing disease states, interactively exploring disease progression patterns, and building, analyzing, and comparing clinically relevant patient subgroups.Comment: to appear at IEEE Transactions on Visualization and Computer Graphic

The MELD-Plus: A generalizable prediction risk score in cirrhosis

Background and aims Accurate assessment of the risk of mortality following a cirrhosis-related admission can enable health-care providers to identify high-risk patients and modify treatment plans to decrease the risk of mortality. Methods: We developed a post-discharge mortality prediction model for patients with a cirrhosis-related admission using a population of 314,292 patients who received care either at Massachusetts General Hospital (MGH) or Brigham and Women’s Hospital (BWH) between 1992 and 2010. We extracted 68 variables from the electronic medical records (EMRs), including demographics, laboratory values, diagnosis codes, and medications. We then used a regularized logistic regression to select the most informative variables and created a risk score that comprises the selected variables. To evaluate the potential for generalizability of our score, we applied it on all cirrhosis-related admissions between 2010 and 2015 at an independent EMR data source of more than 18 million patients, pooled from different health-care systems with EMRs. We calculated the areas under the receiver operating characteristic curves (AUROCs) to assess prediction performance. Results: We identified 4,781 cirrhosis-related admissions at MGH/BWH hospitals, of which 778 resulted in death within 90 days of discharge. Nine variables were the most effective predictors for 90-day mortality, and these included all MELD-Na’s components, as well as albumin, total cholesterol, white blood cell count, age, and length of stay. Applying our nine-variable risk score (denoted as “MELD-Plus”) resulted in an improvement over MELD and MELD-Na scores in several prediction models. On the MGH/BWH 90-day model, MELD-Plus improved the performance of MELD-Na by 11.4% (0.78 [95% CI, 0.75–0.81] versus 0.70 [95% CI, 0.66–0.73]). In the MGH/BWH approximate 1-year model, MELD-Plus improved the performance of MELD-Na by 8.3% (0.78 [95% CI, 0.76–0.79] versus 0.72 [95% CI, 0.71–0.73]). Performance improvement was similar when the novel MELD-Plus risk score was applied to an independent database; when considering 24,042 cirrhosis-related admissions, MELD-Plus improved the performance of MELD-Na by 16.9% (0.69 [95% CI, 0.69–0.70] versus 0.59 [95% CI, 0.58–0.60]). Conclusions: We developed a new risk score, MELD-Plus that accurately stratifies the short-term mortality of patients with established cirrhosis, following a hospital admission. Our findings demonstrate that using a small set of easily accessible structured variables can help identify novel predictors of outcomes in cirrhosis patients and improve the performance of widely used traditional risk scores

Genetics of myocardial interstitial fibrosis in the human heart and association with disease

Myocardial interstitial fibrosis is associated with cardiovascular disease and adverse prognosis. Here, to investigate the biological pathways that underlie fibrosis in the human heart, we developed a machine learning model to measure native myocardial T1 time, a marker of myocardial fibrosis, in 41,505 UK Biobank participants who underwent cardiac magnetic resonance imaging. Greater T1 time was associated with diabetes mellitus, renal disease, aortic stenosis, cardiomyopathy, heart failure, atrial fibrillation, conduction disease and rheumatoid arthritis. Genome-wide association analysis identified 11 independent loci associated with T1 time. The identified loci implicated genes involved in glucose transport (SLC2A12), iron homeostasis (HFE, TMPRSS6), tissue repair (ADAMTSL1, VEGFC), oxidative stress (SOD2), cardiac hypertrophy (MYH7B) and calcium signaling (CAMK2D). Using a transforming growth factor β1-mediated cardiac fibroblast activation assay, we found that 9 of the 11 loci consisted of genes that exhibited temporal changes in expression or open chromatin conformation supporting their biological relevance to myofibroblast cell state acquisition. By harnessing machine learning to perform large-scale quantification of myocardial interstitial fibrosis using cardiac imaging, we validate associations between cardiac fibrosis and disease, and identify new biologically relevant pathways underlying fibrosis.</p

Passive Heating Attenuates Post-Exercise Cardiac Autonomic Recovery in Healthy Young Males

Post-exercise heart rate (HR) recovery (HRR) presents a biphasic pattern, which is mediated by parasympathetic reactivation and sympathetic withdrawal. Several mechanisms regulate these post-exercise autonomic responses and thermoregulation has been proposed to play an important role. The aim of this study was to test the effects of heat stress on HRR and HR variability (HRV) after aerobic exercise in healthy subjects. Twelve healthy males (25 ± 1 years, 23.8 ± 0.5 kg/m2) performed 14 min of moderate-intensity cycling exercise (40–60% HRreserve) followed by 5 min of loadless active recovery in two conditions: heat stress (HS) and normothermia (NT). In HS, subjects dressed in a whole-body water-perfused tube-lined suit to increase internal temperature (Tc) by ~1°C. In NT, subjects did not wear the suit. HR, core and skin temperatures (Tc and Tsk), mean arterial pressure (MAP) skin blood flow (SKBF), and cutaneous vascular conductance (CVC) were measured throughout and analyzed during post-exercise recovery. HRR was assessed through calculations of HR decay after 60 and 300 s of recovery (HRR60s and HRR300s), and the short- and long-term time constants of HRR (T30 and HRRt). Post-exercise HRV was examined via calculations of RMSSD (root mean square of successive RR intervals) and RMS (root mean square residual of RR intervals). The HS protocol promoted significant thermal stress and hemodynamic adjustments during the recovery (HS-NT differences: Tc = +0.7 ± 0.3°C; Tsk = +3.2 ± 1.5°C; MAP = −12 ± 14 mmHg; SKBF = +90 ± 80 a.u; CVC = +1.5 ± 1.3 a.u./mmHg). HRR and post-exercise HRV were significantly delayed in HS (e.g., HRR60s = 27 ± 9 vs. 44 ± 12 bpm, P < 0.01; HRR300s = 39 ± 12 vs. 59 ± 16 bpm, P < 0.01). The effects of heat stress (e.g., the HS-NT differences) on HRR were associated with its effects on thermal and hemodynamic responses. In conclusion, heat stress delays HRR, and this effect seems to be mediated by an attenuated parasympathetic reactivation and sympathetic withdrawal after exercise. In addition, the impact of heat stress on HRR is related to the magnitude of the heat stress-induced thermal stress and hemodynamic changes

Childhood Height Growth Rate Association With the Risk of Islet Autoimmunity and Development of Type 1 Diabetes

ContextRapid growth has been suggested to promote islet autoimmunity and progression to type 1 diabetes (T1D). Childhood growth has not been analyzed separately from the infant growth period in most previous studies, but it may have distinct features due to differences between the stages of development. Objective We aimed to analyze the association of childhood growth with development of islet autoimmunity and progression to T1D diagnosis in children 1 to 8 years of age.MethodsLongitudinal data of childhood growth and development of islet autoimmunity and T1D were analyzed in a prospective cohort study including 10 145 children from Finland, Germany, Sweden, and the United States, 1-8 years of age with at least 3 height and weight measurements and at least 1 measurement of islet autoantibodies. The primary outcome was the appearance of islet autoimmunity and progression from islet autoimmunity to T1D.ResultsRapid increase in height (cm/year) was associated with increased risk of seroconversion to glutamic acid decarboxylase autoantibody, insulin autoantibody, or insulinoma-like antigen-2 autoantibody (hazard ratio [HR] = 1.26 [95% CI = 1.05, 1.51] for 1-3 years of age and HR = 1.48 [95% CI = 1.28, 1.73] for >3 years of age). Furthermore, height rate was positively associated with development of T1D (HR = 1.80 [95% CI = 1.15, 2.81]) in the analyses from seroconversion with insulin autoantibody to diabetes.ConclusionRapid height growth rate in childhood is associated with increased risk of islet autoimmunity and progression to T1D. Further work is needed to investigate the biological mechanism that may explain this association.</p